Skip to content

Conversation

@breardon2011
Copy link
Contributor

@breardon2011 breardon2011 commented Sep 29, 2025

Adds modular DB backing, allow bucketstore abstraction.

Note: a large amount of the LOC change is the test suite and data.

@breardon2011 breardon2011 marked this pull request as ready for review October 7, 2025 03:46
Discovered a flaw in sqlstore's handling of wildcard perms during testing, adjusted
Adjustd the s3 store to enable testing with this definition instead of separate mock

Added tests for different aspects of the query engine, especially rbac and unit management.
@breardon2011 breardon2011 changed the title SQLite Proof of Concept DB Query Engine Oct 9, 2025
analytics.InitGlobalWithSystemID("production", store)

// 3. Create the base OrchestratingStore
orchestratingStore := storage.NewOrchestratingStore(blobStore, queryStore)
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

this orchestrating store is grouping blobStore and queryStore which are both unrelated it seems, just use UnitStore and QueryStore independently ?

@breardon2011 breardon2011 requested a review from motatoes October 14, 2025 19:40
// ============================================

// TFEOperations defines what TFE handler needs.
// TFE needs to auto-create workspaces but not list/delete/version operations.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

is this true that we "auto-create" I thought that we dont auto-create but rather we require them to be created before any operation on them would succeed

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

yeah thats a good catch i'll confirm the behaviour now and adjust

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

we do prevent auto create in most but there was one where not it turns out (createstateversiondirect), I'll adjust both that method and the comment

@@ -0,0 +1,601 @@
# Test Suite Guide - Quick Reference
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

is this doc adding any value? maybe an explanation on running the tests but what's summarising the number of tests will immediately go out of sync with the code. I would remove all but example commands on how to run the tests

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

yeah thats a good point, sort of made it for myself initially but through that lens it should probably be minimal i agree

@@ -0,0 +1,67 @@
package observability
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I didn't quite understand this and the other sync methods in query/internal/sql_store.go

Copy link
Contributor

@motatoes motatoes left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

we need a workflow to run the test suite in here on every pr open

@breardon2011 breardon2011 merged commit 87294ba into develop Oct 15, 2025
11 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants